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Abstract 

A  wavelet  is  a  relatively  new  mathematical  tool  that  can  be  used  to  analyze  data  arising  in  PTTI 
applications.  This  paper  presents  a  basic  introduction  to  wavelets  and  wavelet  analysis.  We  also  look 
briefly  at  some  specific  uses  for  wavelets  with  PTTI  data,  including  (I)  tracking  data  whose  statistical 
properties  are  evolving  over  time,  (2)  decomposing  the  sample  variance  for  a  set  of  data  into  components 
that  are  attributable  to  variations  over  different  scales,  and  (3)  decorrelating  highly  correlated  data. 


What  is  a  Wavelet? 


•  sines  &  cosines  are  ‘big  waves' 


u 


•  wavelets  are  ‘small  waves'  (left-Iiaiid  is  Haar  wavelet 
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What  is  Wavelet  Analysis?:  I 


•  multiply  wavelet  &  time  series  a;(w)  together  &  integrate: 


•  '0‘"’(u)a:{u)  du  =  W(1,0)  is  proportional  to  difference 
between  averages  of  ar{ti)  ovtT  intervals  [—1,0]  and  [0, 1] 

•  defiins  wavelet  coefficient  W(1,0)  for 

—  scale  1  (width  of  each  interval) 

—  time  0  (center  of  combined  intervals) 
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What  is  Wavelet  Analysis?:  II 


•  stretch  or  shrink  wavelet  to  define  W  (r,  0)  for  other  scales  r 


•  relocate  to  define  W{t,  t)  for  other  times  t: 


I  i  I  I  I  I  1 1  -I.  I  I  .1  1 1  ■  I  I  i  »  I 

-3  0  3-3  0  3  -3  0  3 

w  t* 


yields  W(l,  1) 
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What  is  Wavelet  Analysis?:  Ill 


•  W (r,  t)  over  all  scales  r  >  0  and  all  times  t  called 
continuous  wavelet  transform  (CWT)  for  a:(u) 

•  CWT  analyzes  x{u)  into  components  that  are 


—  associated  with  a  scale  arifl  a  time 

—  physic-ally  related  to  a  difFerenc^e  of  averages 


similar  interpretation  for  other  wavelets 

W{T,t)  eciiii valent  to  a:(M)  siiic;e,  givcni  CWT,  can  recover  x{u) 


i  ^  ill  (^) 


dr, 


whore  is  a  constant  depending  on  specific  wavelet  't{i{u) 
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Maximal  Overlap  Discrete  Wavelet  TVansform 


•  let  X  =  [Xq, Xi, . . .  ,  Xjv-i]^  be  obsciived  time  series 

•  can  formulate  MODWT  of  X  as  vectors  Wp  . . .  ,  W./^  &  V./^ 
each  of  dimension  N  (number  of  levels  Jq  chosen  by  user) 

•  Wj  contains  wavelet  coefficients,  j  =  1, . . .  ,  Jq 

—  associated  with  differenc;es  in  avc^rages  over  scale  Tj  = 

—  closely  related  to  W{rj,  t)  over  restricted  set  of  times 

•y Jq  contains  scaling  coefficients 

—  associatcxl  with  averages  over  scale  2ry^  =  2'^^ 

—  summarizes  W (r,  t)  over  scales  r  >  Tj^ 

•  X  &  MODWT  cxpii valent:  given  MODWT,  can  recovesr  X 
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Example:  MODWT  Coefficients  for  Clock  55 
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t  (daif's) 

•  can  use  to  track  variations  across  time  at  a  given  scale 


Wavelet-Based  Analysis  of  Variance:  I 

•  consifler  ‘energy’  in  time  series:  ||X1|^  -  X^X  -  Xf 

•  energy  preserved  in  MODWT  coefficients: 

■Jo  _  _ 

l|X||2  =  Y,  I|W,|P  +  l|V,y„||2 

•  leads  to  analysis  of  sample  variance: 


wliere  /iy  =  ^  mean 
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Wavelet-Based  Analysis  of  Variance:  II 

•  if ^  realization  of  i)rocess  with  stationary  increments, 

II W is  estimator  of  wavelet  variance  (tj) 

•  wavelet  variance  analyzes  prot^ess  variaiK^e  across  scales  rj: 

oo 

(note:  can  be  infinite  for  certain  processes) 

•  si)tx.*ial  t;ase:  Haar  wavelet  variance  with  fractional  frecpiency 
deviates  Y t  essentially  same  as  Allan  variance  tj)  since 

(2.  Tj) 

•  Q:  ‘old  wine  in  a  new  bottle,’  or  something  new? 


What  Wavelets  Bring  to  the  Table 

•  2|[Wy||2/V  givt^  a  previously  nnkiiown  («timator  for  cry{2,  tj) 

•  with  addition  of  ‘rcflec'tion’  boundary  conditions,  estimator  is 
an  imiM'ovcmcnt  over  existing  estimators  (smaller  mean  square 
error;  Grccnhall,  Howe  &  Pcrcival,  1999) 

•  non-Haar  wavelets  provide  interesting  generalizations 

—  still  provide  exacd.  decompositions  of  sample  variance 

—  can  handle  wider  range  of  power  laws 

—  can  handle  polynomial  trends  of  certain  orders 

—  competitive  with  modified  Allan  variance 

•  unified  theory  provides  methods  for  getting  confidence  intervals 
that  do  not  reciuire  a  prior  assumption  of  noise  type 
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Discrete  Wavelet  Transform  (DWT) 

•  obtain  by  subsainpling  and  rescaling  MODWT 

•  yields  vectors  Wi ,  . . .  ,  W 

—  Wy  has  N/2^  wavelet  coefficients 

—  Vjq  has  N/2'^^  scaling  coefficients 

•  total  #  of  DWT  coefficients  is  A^,  i.e.,  dimension  of  X 

•  X  &  DWT  equivalent:  given  DWT,  can  recover  X 

•  DWT  acts  as  a  dectmtdating  traiisftnrn 


II 


Example:  DWT  Coefficients  for  Clock  55  X{. 
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•  have  approximate  within-scale  k.  between-scale  decorrelation 
(non-Haar  wavelets  offer  better  between-scale  api>roxiniation) 
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Uses  for  DWT  Decorrelating  Property 

•  estimation  of  i)ai  amet.em  for  statistical  models 

—  consider  modeling  X  as  pro<;ess  with  spectrum 

sx(f)  =  ci/r 

—  power- law  model  depends  on  ijarameters  C  and  q 

—  (xnisider  estimating  C  and  a  via  maxiimmi  likelihood  (ML) 

—  exact  ML  estimators  difficult  to  obtain 

—  DWT  yields  simj)le,  but  effetitive,  aj)proxiniate  ML  (estimator 

•  testing  for  homogeneity  of  X  at  seale  rj  across  time 

•  assessing  variability  in  certain  statistics  via  bootstrapping 

•  fast  simulation  of  time  series 
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Other  Potential  Uses  for  Wavelets  in  PTTI 

•  multiresolution  analysis  (bas(xl  on  wavelet  synthesis  of  X) 

•  detection  of  singularities  (maximum  modulus  of  CWT) 

•  data  eomju'ession 

•  signal  extraction  (wavelet  shrinkage) 
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Summary 

•  wavelets  give  insight  into  frequency  instability  characterization 

—  cinphasizc  role  of  exact  analysis  of  proccss/saini)lc  variance 

—  provide  estimators  with  reduced  mean  scpiare  error 

•  wavelets  lead  to  easily  coni])iited  approximate  maximmii  likeli- 
IkxkI  estimators  for  parameters  (jf  ]>ower-law  proc*esses 

•  many  other  potential  uses 

—  article  #20.654  is  waiting  to  be  written! 

•  thanks  to  conference  organizers  for  invitation  to  speak! 


IS 
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Questions  and  Answers 

MARC  WEISS  (National  Institute  of  Standards  and  Technology):  How  does  the  wavelet 
analysis  compare  in  terms  of  the  long  term?  There  is  a  problem  with  getting  a  long-term  Allan 
variance  in  terms  of  confidence  and  bias.  Does  the  wavelet  variance,  if  you  have  a  variance  via 
wavelet  analysis,  improve  the  problem? 

DON  PERCIVAL:  Yes,  it  does.  In  the  work  I  did  with  Dave  Howe  and  Chuck  Greenhall  on 
TOTVAR,  what  you  are  doing  is  getting  a  bias  estimate  of  the  wavelet  of  the  Allan  variance  using 
this  scheme  right  here.  But  it  has  associated  with  it  a  smaller  variance.  In  other  words,  the  total 
mean  squared  area  can  show  that  it  decreased.  So  it  gives  the  superior  estimate  out  the  very,  very 
longest  time  scales.  That  is  probably  the  big  advantage. 

WEISS:  So  it  is  essentially  TOTVAR 

PERCIVAL:  Yes,  with  a  Haar  thing,  it  ends  being  TOTVAR.  So  you  can  regard  TOTVAR  as  a 
wavelet-based  estimator  of  the  Allan  variance.  So  it  is  just  a  new  estimator  of  the  Allan  variance. 

FRANCOIS  VERNOTTE  (Observatoire  de  Besan^on):  In  the  literature,  there  are  many  different 
wavelet  chips.  How  is  it  possible  to  choose  the  right  one  for  a  given  problem? 

PERCIVAL:  It  is  not  that  difficult.  The  Daubechie  family  of  wavelets  is  a  series  of  filters  of 
different  lengths.  So  the  Haar  is  length  two.  There  is  a  length  four,  length  six,  and  length  eight. 
What  I  found  to  be  a  very  effective  thing  is  just  to  do  an  analysis  in  which  you  look  at  what  you  get 
for  the  different  wavelet  lengths.  What  you  will  often  find  is  that  sometimes  the  Haar  is  not 
adequate,  because  it  has  certain  leakage  properties.  That  is  why  the  Allan  variance  has  problems  at 
times.  When  you  go  to  these  higher  order  things,  things  will  stabilize  and  you  will  find  that  using  the 
length  four  wavelet  and  the  length  six  wavelet  gives  you  about  the  same  thing.  So  that  means  you 
can  back  off  and  just  use  the  length  four  one.  So  there  are  some  very  simple  little  techniques  you  can 
use  in  order  to  pick  an  appropriate  wavelet  from  amongst  the  Daubechie  family  of  wavelets. 

DENNIS  McCarthy  (U.S.  Naval  Observatory):  Just  a  quick  question.  One  of  the  concerns  for 
people  in  this  community  is  you  have  fixed  finite-length  data,  and  you  would  like  to  determine  what 
is  the  stochastic  data  and  what  is  sort  of  the  underlying  trend.  Have  you  thought  about  a  way  the 
wavelets  might  be  used  to  separate  the  deterministic  part  from  the  noise  part? 

PERCIVAL:  Yes.  If  the  trend  can  be  modeled  as  a  low-order  polynomial,  what  happens  is  that 
polynomial  will  not  show  up  at  all  in  the  wavelet  coefficients.  You  can  in  a  certain  sense  handle 
polynomial  trends  very  easily.  The  Haar  wavelet  has  a  first  difference  in  it.  The  next  wavelet  up  has 
a  second  difference  and  the  next  wavelet  up  has  a  third  difference.  So  a  third  difference  would  kill 
off  a  quadratic  term,  which  would  get  rid  of  them  totally.  By  going  to  the  higher-order  wavelet,  you 
can  actually  automatically  handle  at  least  polynomial  trends  and  get  out  coefficients  which  are 
impervious  to  that  trend  background. 

McCarthy:  a  quick  comment.  The  wavelet  business  here  has  been  why  it  has  received 
widespread  use  in  the  geodetic  and  geophysical  community.  Something  you  did  not  mention  was 
looking  at  the  spectral  content  of  time  series  as  a  function  of  time.  That  has  proved  to  be  extremely 
useful  to  establish  the  spectra  of  various  physical  processes  as  a  function  of  time,  which  can  be  done 
with  this. 
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PERCIVAL:  Right,  exactly.  So  that  little  example  I  gave  where  the  clock  seemed  to  be  increasing 
in  variability  toward  the  end  is  exactly  what  you  are  talking  about.  Because  the  scale  eight  things 
would  relate  to  a  certain  band  of  frequencies;  you  can  use  that  to  track  the  frequency  variations 
across  time.  So,  yes,  that  is  a  very  good  point. 
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